A Syndetic Approach To Referring Phenomena In Multimodal Interaction
نویسندگان
چکیده
منابع مشابه
Relevance and Perceptual Constraints in Multimodal Referring Actions
This paper presents a first attempt to score the relevance of multimodal referring expressions within a task oriented environment. It is based upon the application of the ecological approach to multimodal system design, which in particular implies that perception has to play a central role in the understanding of a gestural designation. The results of an experimental work is presented, together...
متن کاملFramework for spontaneous 3D referring gestures analysis
This paper presents a framework proposal aiming at analysing 3D spontaneous referring gestures which occur in multimodal interactions. Our approach is co mposed by two main steps: a structural segmentation of 3D continuous gestural signal and a perception or iented interpretation stage. Both modules which already exist have now to be merged, and the whole process validated with actual t ajector...
متن کاملSpeech and 2D Deictic Gesture Reference to Virtual Scenes
Humans make ample use of deictic gesture and spoken reference in referring to perceived phenomena in the spatial environment, such as visible objects, sound sources, tactile objects, or even sources of smell and taste. Multimodal and natural interactive systems developers are beginning to face the challenges involved in making systems correctly interpret user input belonging to this general cla...
متن کاملCombining Semantic And Temporal Constraints For Multimodal Integration In Conversation Systems
In a multimodal conversation, user referring patterns could be complex, involving multiple referring expressions from speech utterances and multiple gestures. To resolve those references, multimodal integration based on semantic constraints is insufficient. In this paper, we describe a graph-based probabilistic approach that simultaneously combines both semantic and temporal constraints to achi...
متن کاملDialogue homme-machine multimodal : de la pragmatique linguistique à la conception de systèmes. (Multimodal human-machine dialogue: from pragmatic linguistics to system design)
Human-machine dialogue aims at providing natural dialogue in natural language, i.e., allowing the user to speak using his own language (natural language), following a structure of moves and exchanges that is similar to human dialogue structure (natural dialogue). Related research works feed on linguistics, which analyses language markers, and pragmatics, which analyses language use in context. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1997